Towards the Socio-Algorithmic Construction of Fairness: The Case of Automatic Price-Surging in Ride-Hailing

Algorithms take decisions that affect humans, and have been shown to perpetuate biases and discrimination. Decisions by algorithms are subject to different interpretations. Algorithms’ behaviors are basis for the construal of moral assessment and standards. Yet we lack an understanding of how algorithms impact on social construction processes, and vice versa. Without such understanding, social construction processes may be disrupted and, eventually, may impede moral progress in society. We analyze the public discourse that emerged after a significant (five-fold) price-surge following the Brooklyn Subway Shooting on April 12 2022, in New York City. There was much controversy around the two ride-hailing firms’ algorithms’ decisions. The discussions evolved around various notions of fairness and the algorithms’ decisions’ justifiability. Our results indicate that algorithms, even if not explicitly addressed in the discourse, strongly impact on constructing fairness assessments and notions. They initiate the exchange, form people’s expectations, evoke people’s solidarity with specific groups, and are a vehicle for moral crusading. However, they are also subject to adjustments based on social forces. We claim that the process of constructing notions of fairness is no longer just social; it has become a socio-algorithmic process. We propose a theory of socio-algorithmic construction as a mechanism for establishing notions of fairness and other ethical constructs

INVOLVEMENT PRACTICES IN PERSUASIVE SERVICE ENCOUNTERS: THE CASE OF HOME SECURITY ADVICE

Advisors providing non-commercial service encounters are neither trained nor explicitly incentivized to persuade the advisee. However, a whole range of encounters may benefit from enhanced persuasiveness to prevent the advisee from taking counterproductive decisions. Persuasion literature from the field of social psychology points to the persuadee’s involvement as a central factor of persuasive effect. Nevertheless, little is known on how persuader addresses persuadee’s involvement and how those efforts can be supported by means of modern technology, especially in the non-commercial service encounters. Based on a detailed analysis of experimental service encounters and supported by the in situ studies of real advisory sessions, this study identifies a set of involvement practices, i.e., conversational practices that advisors engage in when trying to improve the advisee’s involvement and illustrates how these practices can be afforded with modern multimedia technology. Thereby, the manuscript proposes to bridge the notions of involvement from the conversation studies and from the persuasion literature. By pointing to the influence of IT on persuasive behaviour in service encounters, it brings together the concept of persuasive technology and service support as a subfield of IS. The manuscript offers novel perspective for framing the conversations and the practices in service encounters

How Fair Is IS Research?

While both information systems and machine learning are not neutral, the identification of discrimination is more difficult if a system learns from data and discrimination can be introduced at several stages. Therefore, this article investigates if IS Research has taken up with this topic. A literature analysis is conducted and its discussion shows that technology, organization, and human aspects have to be considered, making it a topic not only for data scientist or computer scientist, but for information systems researchers as well

Why do you ask all those questions? Supporting client profiling in financial service encounters

Client data is key to provide personalized services and products. Therefore, banks go through great efforts to profile their clients during financial advisory service encounters. Since traditional pen-and-paper profiling does not satisfy the banks’ needs, they strive to digitalize this activity. This paper offers joint profiling as a solution: The advisor and the client jointly create a client’s profile using a shared display. However, test clients provided a mixed response to a first joint profiling prototype. They wondered, why the bank needs all this information. In a second iteration, joint profiling was augmented by task awareness, i.e., linking all profiled information to the client\u27s goal. This task aware joint profiling was far better accepted by the clients. This paper offers research insights on the role of profiling in face-to-face advisory service encounters, on its acceptance by the clients, and on design principles for digital profiling in financial service encounters

Project archetypes: A blessing and a curse for AI development

Software projects rely on what we call project archetypes, i.e., pre-existing mental images of how projects work. They guide distribution of responsibilities, planning, or expectations. However, with the technological progress, project archetypes may become outdated, ineffective, or counterproductive by impeding more adequate approaches. Understanding archetypes of software development projects is core to leverage their potential. The development of applications using machine learning and artificial intelligence provides a context in which existing archetypes might outdate and need to be questioned, adapted, or replaced. We analyzed 36 interviews from 21 projects between IBM Watson and client companies and identified four project archetypes members initially used to understand the projects. We then derive a new project archetype, cognitive computing project, from the interviews. It can inform future development projects based on AI-development platforms. Project leaders should proactively manage project archetypes while researchers should investigate what guides initial understandings of software projects

The power of words: Towards a methodology for progress monitoring in design thinking projects

The popularity of design thinking as an innovation paradigm grows continuously. More and more schools and firms implement innovation processes inspired by design thinking, but they lack easy and nonintrusive methods for monitoring the progress of teams following those processes. Consequently, interventions from coaches, teachers, or supervisors tend to rely on intuition or require intensive and intrusive examination of team dynamics. This study uses by-products from the design process and proposes automated assessment of lexical diversity as a monitoring method in process-driven design thinking projects. Thereby, it contributes to the research on the relation between text production and creativity in design projects. To the practical end, it suggests how digitalized by-products of design activities such as notes and documentation, can be leveraged to support the teams as well as coaches, teachers, and supervisors

From Solution Trap to Solution Patchwork: Tensions in Digital Health in the Global Context

This paper problematizes underlying assumptions in Design Science Research – and Information Systems Research more broadly by conceptualizing the „solution trap“. The solution trap is caused by the incompatibility of co-existing solutions in complex socio-technical contexts. Information systems bring diverse cultures and theories together, causing tensions in the different institutional logics. We emphasize the need for a nuanced understanding of context unevenness and propose solution patchwork as a coordination approach to evade the solution trap. Substantiating the preliminary insights and propositions with a literature review and further empirical grounding will transition this research-in-progress to a full paper

When a computer speaks institutional talk: Exploring challenges and potentials of virtual assistants in face-to-face advisory services

Advisory services are a highly sensitive form of collaboration: they rely on a clear distribution of roles between human participants who act according to an implicit set of practices and scripts. As such, they do not offer a specific role to a virtual assistant. At the same time, the technological improvements make the promise that institutional settings may be soon complemented with technology that allows for asking questions using natural speech, understands the context, and provides answers based on online processing of data. This article explores challenges and potentials of virtual assistants in advisory services while analyzing data from interviews and a workshop with clients and advisors from financial advisory services. It links the insights from the field with the institutional talk perspective. The findings unveil, that the concerns and hopes of potential users relate to their position and an implicit understanding of what an advisory service is about. This calls for careful and attentive design approach towards virtual assistants in advisory services

Project Archetypes: A Blessing and a Curse for AI Development

Software projects rely on what we call project archetypes, i.e., pre-existing mental images of how projects work. They guide distribution of responsibilities, planning, or expectations. However, with the technological progress, project archetypes may become outdated, ineffective, or counterproductive by impeding more adequate approaches. Understanding archetypes of software development projects is core to leverage their potential. The development of applications using machine learning and artificial intelligence provides a context in which existing archetypes might outdate and need to be questioned, adapted, or replaced. We analyzed 36 interviews from 21 projects between IBM Watson and client companies and identified four project archetypes members initially used to understand the projects. We then derive a new project archetype, cognitive computing project, from the interviews. It can inform future development projects based on AI-development platforms. Project leaders should proactively manage project archetypes while researchers should investigate what guides initial understandings of software projects

From Solution Trap to Solution Patchwork: Tensions in Digital Health in the Global Context

This paper problematizes underlying assumptions in Design Science Research – and Information Systems Research more broadly by conceptualizing the „solution trap“. The solution trap is caused by the incompatibility of co-existing solutions in complex socio-technical contexts. Information systems bring diverse cultures and theories together, causing tensions in the different institutional logics. We emphasize the need for a nuanced understanding of context unevenness and propose solution patchwork as a coordination approach to evade the solution trap. Substantiating the preliminary insights and propositions with a literature review and further empirical grounding will transition this research-in-progress to a full paper